Globus Toolkit
   HOME

TheInfoList



OR:

The Globus Toolkit is an
open-source Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...
toolkit for
grid computing Grid computing is the use of widely distributed computer resources to reach a common goal. A computing grid can be thought of as a distributed system with non-interactive workloads that involve many files. Grid computing is distinguished from co ...
developed and provided by the
Globus Alliance The Globus Alliance is an international association founded by the University of Chicago and the Argonne National Laboratory dedicated to developing fundamental technologies needed to build grid computing infrastructures. The Globus Alliance was ...
. On 25 May 2017 it was announced that the open source support for the project would be discontinued in January 201

due to a lack of financial support for that work. The Globus service continues to be available to the research community under a
freemium Freemium, a portmanteau of the words "free" and "premium," is a pricing strategy by which a basic product or service is provided free of charge, but money (a premium) is charged for additional features, services, or virtual (online) or physical (o ...
approach, designed to sustain the software, with most features freely available but some restricted to subscriber

In late 2017 th
Grid Community Forum
(GridCF) created a fork of the Globus Toolkit named the '
Grid Community Toolkit
'' or GCT in short and took over maintenance and development of the code base. The GridCF added support for Transport_Layer_Security#TLS_1.3, TLS 1.3 and also compatibility with OpenSSL 3.0 to its fork of the Globus Toolkit. GCT packages are available from EPEL/Fedora for Red Hat Enterprise Linux 7 to 9 and compatible distributions and
Fedora Linux Fedora Linux is a Linux distribution developed by the Fedora Project. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of open-source technologies. Fedora is the upstream sourc ...
, for
Debian GNU/Linux Debian (), also known as Debian GNU/Linux, is a Linux distribution composed of free and open-source software, developed by the community-supported Debian Project, which was established by Ian Murdock on August 16, 1993. The first version of Deb ...
and
Ubuntu Ubuntu ( ) is a Linux distribution based on Debian and composed mostly of free and open-source software. Ubuntu is officially released in three editions: ''Desktop'', ''Server'', and ''Core'' for Internet of things devices and robots. All the ...
from the official package repositories and also
SUSE Linux Enterprise SUSE Linux Enterprise (often abbreviated to SLE) is a Linux-based operating system developed by SUSE. It is available in two editions, suffixed with Server (SLES) for servers and mainframes, and Desktop (SLED) for workstations and desktop comp ...
and
openSUSE openSUSE () is a free and open-source software, free and open source RPM Package Manager, RPM-based Linux distribution developed by the openSUSE project. The initial release of the community project was a beta version of SUSE Linux 10.0. Addi ...
distributions from the Open Build Service.


Introduction

The Globus toolkit contains a set of libraries and programs that provides the developers of specific tools or apps with solutions for common problems that are encountered when creating a distributed system services and applications. Globus is a software with components and capabilities that includes: #A set of service Implementations that Indicate resource management, data alterations service finding and relevant issues #Tools for building web services #A powerful standards-based security prerequisites for authentication and authorisation. #Various services in java c and python for clients of API and command line programs #Detailed documentation on these various components


Standards implementation

The Globus Toolkit adheres to or provides implementations of the following standards: *
Open Grid Services Architecture Open Grid Services Architecture (OGSA) describes a service-oriented architecture for a grid computing environment for business and scientific use. It was developed within the Open Grid Forum, which was called the Global Grid Forum (GGF) at the ti ...
(OGSA) *
Open Grid Services Infrastructure The Open Grid Services Infrastructure (OGSI) was published by the Global Grid Forum (GGF) as a proposed recommendation in June 2003. It was intended to provide an infrastructure layer for the Open Grid Services Architecture (OGSA). OGSI takes the ...
(OGSI), originally intended to form the basic “plumbing” layer for OGSA, but has been superseded by WSRF and WS-Management. *
Web Services Resource Framework Web Services Resource Framework (WSRF) is a family of OASIS-published specifications for web services. Major contributors include the Globus Alliance and IBM. A web service by itself is nominally stateless, i.e., it retains no data between ...
(WSRF) *
Job Submission Description Language Job Submission Description Language is an extensible XML specification from the Global Grid Forum for the description of simple tasks to non-interactive computer execution systems. Currently at version 1.0 (released November 7, 2005), the specificat ...
(JSDL) * Distributed Resource Management Application API (DRMAA) *
WS-Management WS-Management (Web Services-Management) is a DMTF open standard defining a SOAP-based protocol for the management of servers, devices, applications and various Web services. WS-Management provides a common way for systems to access and exchange ma ...
* WS-BaseNotification *
SOAP Soap is a salt of a fatty acid used in a variety of cleansing and lubricating products. In a domestic setting, soaps are surfactants usually used for washing, bathing, and other types of housekeeping. In industrial settings, soaps are use ...
*
Web Services Description Language The Web Services Description Language (WSDL ) is an XML-based interface description language that is used for describing the functionality offered by a web service. The acronym is also used for any specific WSDL description of a web service (also ...
*
Grid Security Infrastructure The Grid Security Infrastructure (GSI), formerly called the Globus Security Infrastructure, is a specification for secret, tamper-proof, delegatable communication between software in a grid computing environment. Secure, authenticatable communicat ...
(GSI) {{Expand list, date=August 2008 The Globus Toolkit has implementations of the OGF-defined
protocol Protocol may refer to: Sociology and politics * Protocol (politics), a formal agreement between nation states * Protocol (diplomacy), the etiquette of diplomacy and affairs of state * Etiquette, a code of personal behavior Science and technology ...
s to provide: #
Resource management In organizational studies, resource management is the efficient and effective development of an organization's resources when they are needed. Such resources may include the financial resources, inventory, human skills, production resources, or i ...
: Grid Resource Allocation & Management Protocol (GRAM) #Information Services: Monitoring and Discovery Service (MDS) #Security Services:
Grid Security Infrastructure The Grid Security Infrastructure (GSI), formerly called the Globus Security Infrastructure, is a specification for secret, tamper-proof, delegatable communication between software in a grid computing environment. Secure, authenticatable communicat ...
(GSI) #Data Movement and Management: Global Access to Secondary Storage (GASS) and
GridFTP GridFTP is an extension of the File Transfer Protocol (FTP) for grid computing. The protocol was defined within the GridFTP working group of the Open Grid Forum. There are multiple implementations of the protocol; the most widely used is that pro ...
The following Globus Toolkit components are supported by the OGF-defined SAGA C++/Python API: # GRAM (2 and 5) via the SAGA job API #
GridFTP GridFTP is an extension of the File Transfer Protocol (FTP) for grid computing. The protocol was defined within the GridFTP working group of the Open Grid Forum. There are multiple implementations of the protocol; the most widely used is that pro ...
via the SAGA filesystem API # Replica Location Service via the SAGA C++ Reference Implementation API


Compatible third-party software

A number of tools can function with Globus Toolkit, including: *
SAGA C++ Reference Implementation is a series of science fantasy role-playing video games by Square Enix. The series originated on the Game Boy in 1989 as the creation of Akitoshi Kawazu at Square. It has since continued across multiple platforms, from the Super NES to the ...
- The Simple API for Grid Applications *WebCom and WebCom-

* Nimrod (distributed computing), Nimrod tools for meta-scheduling and parametric computing *Gridbu
Grid Service Broker
*Grid Portal Software such as GridPort
OGCEGridSphere
an
P-GRADE Portal
*Grid Packaging Toolkit (GPT)

(Grid Enabled MPI) *Network Weather Service (NWS) (Quality-of-Service monitoring and statistics) *
HTCondor HTCondor is an open-source high-throughput computing software framework for coarse-grained distributed parallelization of computationally intensive tasks. It can be used to manage workload on a dedicated cluster of computers, or to farm out wor ...
( CPU Cycle Scavenging) and Condor-G (Job Submission)
HPC4U Middleware
(Fault Tolerant and SLA aware Grid Middleware) *
GridWay GridWay is an open-source meta-scheduling technology that enables large-scale, secure, reliable and efficient sharing of computing resources (clusters, computing farms, servers, supercomputers...), managed by different distributed resource manag ...
metascheduler
XML Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable. T ...
-based web services offer a way to access the diverse services and applications in a distributed environment. In 2004,
Univa Corporation Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in Septe ...
began providing commercial support for the Globus Toolkit using a business model similar to that of
Red Hat Red Hat, Inc. is an American software company that provides open source software products to enterprises. Founded in 1993, Red Hat has its corporate headquarters in Raleigh, North Carolina, with other offices worldwide. Red Hat has become ass ...
.


Job schedulers

GRAM ( Grid Resource Allocation Manager), a component of the Globus Toolkit, officially supports the following
job scheduler A job scheduler is a computer application for controlling unattended background program execution of jobs. This is commonly called batch scheduling, as execution of non-interactive jobs is often called batch processing, though traditional ''job'' ...
s or batch-queuing systems: *
Portable Batch System Portable Batch System (or simply PBS) is the name of computer software that performs job scheduling. Its primary task is to allocate computational tasks, i.e., batch jobs, among the available computing resources. It is often used in conjunction ...
, a computer software
job scheduler A job scheduler is a computer application for controlling unattended background program execution of jobs. This is commonly called batch scheduling, as execution of non-interactive jobs is often called batch processing, though traditional ''job'' ...
that allocates network resources to batch jobs. * HTCondor High-Throughput Computing System, a software framework for coarse-grained distributed parallelization of computationally intensive tasks. *
Platform LSF IBM Spectrum LSF (LSF, originally Platform Load Sharing Facility) is a workload management platform, job scheduler, for distributed high performance computing (HPC) by IBM. Details It can be used to execute batch jobs on networked Unix and Windo ...
, a commercial computer software
job scheduler A job scheduler is a computer application for controlling unattended background program execution of jobs. This is commonly called batch scheduling, as execution of non-interactive jobs is often called batch processing, though traditional ''job'' ...
. Unofficial
job scheduler A job scheduler is a computer application for controlling unattended background program execution of jobs. This is commonly called batch scheduling, as execution of non-interactive jobs is often called batch processing, though traditional ''job'' ...
s that can be used with the Globus Toolkit: *
Sun Grid Engine Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), was a grid computing computer cluster software system (otherwise known as a batch-queui ...
, an open source batch-queuing system, supported by
Sun Microsystems Sun Microsystems, Inc. (Sun for short) was an American technology company that sold computers, computer components, software, and information technology services and created the Java programming language, the Solaris operating system, ZFS, the ...
. Globus does not officially support SGE, but third parties offer methods to integrate it: **The London e-Science Center has created a "Transfer-queue over Globus (TOG)" package and provides instructions on how to configure
Globus Toolkit 2 or 3
or

server so that it can submit jobs for execution on a local Sun Grid Engine installation. *
Simple Linux Utility for Resource Management The Slurm Workload Manager, formerly known as Simple Linux Utility for Resource Management (SLURM), or simply Slurm, is a free and open-source job scheduler for Linux and Unix-like kernels, used by many of the world's supercomputers and compu ...
(SLURM), an open source batch-queuing system originally developed at
LLNL Lawrence Livermore National Laboratory (LLNL) is a federal research facility in Livermore, California, United States. The lab was originally established as the University of California Radiation Laboratory, Livermore Branch in 1952 in response ...
and currently managed b
SchedMD
Globus can be used with SLURM via shell wrappers.
/ref>


Development plans

The Globus Alliance announced a release of Globus Toolkit version 5 (GT5) in late 200

http://www.globus.org/news.html#161] A major change will be abandoning GRAM4 (although continuing support at least through December, 2010) in favor of an enhanced GRAM2, called GRAM5, which will solve scalability issues and add features. The Reliable File Transfer (RFT) service will be replaced by a new Globus.org service. Globus.org is an online, hosted service (i.e., Software-as-a-Service) that provides higher-level, end-to-end Grid capabilities, initially concentrating on reliable, high-performance, fire-and-forget data transfer. To retain the Web-Service functionality without technology and standards now considered obsolete, a new project called Globus Cru

has been started, which expects to release an alpha version by the end of 2009. The monitoring and discovery tasks currently performed by MDS will be taken up by a new, Crux-based Integrated Information Services (IIS). No releases of the IIS are planned until sometime in 2010. The release of GT 5.0.2 wa
announced
on 19 July 2010. GT 5.0.3 is reported due for release in February 2011.


Use

* caGrid is layered on Globus Java WS Core *
Advanced Resource Connector Advanced Resource Connector (ARC) is a grid computing middleware introduced by NorduGrid. It provides a common interface for submission of computational tasks to different distributed computing systems and thus can enable grid infrastructures of ...
, open source grid middleware introduced by
NorduGrid NorduGrid is a collaboration aiming at development, maintenance and support of the free Grid middleware, known as the Advanced Resource Connector (ARC). History The name ''NorduGrid'' first became known in 2001 as short for the project called ...


See also

* gCube system * gLite


References


External links


Globus Toolkit homepage
Grid computing products